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UXO  Discrimination  at  Camp  Beale 


•  Apply  practical  UXO 
discrimination  techniques  to  all 
EMI  data  sets  collected. 

•  Evaluate  discrimination 
performance  using  portable  EMI 
sensor  data 


UXO  discrimination  at  Camp  Beale 


*  UXO  at  site 


UXO  discrimination  at  Camp  Beale 
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Data  Acquired  at  Camp  Beale 


Treed  Area 

•  EM61 

•  TEMTADS  2x2 

•  MPV 

•  BUD 


UXO  discrimination  at  Camp  Beale 
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UXO  discrimination  at  Camp  Beale 
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UXO  discrimination  at  Camp  Beale 
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UXO  discrimination  at  Camp  Beale 
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UXO  Discrimination  at  Camp  Beale 


•  Discrimination  limited  by  similarity  of  UXO  vs.  scrap 
features 
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UXO  Discrimination  at  Camp  Beale 


•  Discrimination  limited  by  similarity  of  UXO  vs.  scrap 
features 


Anomaly 

BE-210 


l _ I  I- 

1  1  ch2  lev 


Anomaly 

BE-410 


0  ^  ch2  lev 


MM 

BUD 

0.1  0.5  1  5  10  0 

.1  0.5  1  5  10 

MM 

BUD 

0.1  0.5  1  5  10 

0.1  0.5  1  5  10 

-  /O./cr* 


iso 


Frag 


Decay 


UXO  Discrimination  at  Camp  Beale 


•  MetalMapper  (Parsons):  Size  vs.  Decay  Feature  space 
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UXO  Discrimination  at  Camp  Beale 


1.  FEATURE  EXTRACTION 

•  Derive  parameters  from  the  data  that  tell  us 
something  about  the  buried  target 

2.  CLASSIFICATION 

•  Features  are  used  to  decide  how  likely  that  a 
particular  anomaly  is  due  to  a  UXO 


Feature  Extraction 


1.  Estimate  target  parameters 

•  Single  source  and  two  source  inversions 

•  Location,  orientation,  polarizabilities 

2.  Data  /Inversion  QC 

•  Look  for  poor  fits  to  the  data 

•  Determine  if  any  anomalies  are  "Can't  Analyze" 

3.  Model  Selection 

•  Determine  which  of  the  models  should  be  used  in  the 
classifier 


Classification 


4.  Request  training  data 

•  Semi-supervised  approach 

5.  Create  Ranked  Anomaly  List 

•  Library  Matching  Method 

•  Support  Vector  Machine  Classifier 

6.  Determine  a  Stop  Digging  Point 

•  Manual:  Visual  inspection  of  list 

•  Automated:  Modeling  the  partial  ROC  curve 


Classification 


4.  Request  training  data 

•  Establish  clusters  of  UXO 

•  Determine  extent  of  UXO  clusters  and  boundaries  with  clutter 
classes. 
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Classification 


4.  Request  training  data 

•  Establish  clusters  of  UXO 

•  Determine  extent  of  UXO  clusters  and  boundaries  with  clutter 
classes. 


Classification 


4.  Request  training  data 

•  Semi-supervised  approach 

5.  Create  Ranked  Anomaly  List 

•  Library  Matching  Method 

•  Support  Vector  Machine  Classifier 

6.  Determine  a  Stop  Digging  Point 

1.  Manual:  Visual  inspection  of  list 

2.  Assigning  a  confidence:  Modeling  the  partial  ROC  curve 


Classification 


6.  Determine  a  Stop  Digging  Point  1:  Manual 

•  Visual  inspection  of  list 


Classification 

6.  Determine  a  Stop  Dig  Point  2:  Assigning  a  Confidence 

Generate  objective  numerical  confidence  that  all  the  UXO  are  found 

•  Test  hypothesis  that  all  UXO  are  found 

•  Fit  a  binormal  model  to  the  observed  partial  ROC  curve 

•  There  is  an  99%  expectation  that  the  FAR  falls  within  the  interval 
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Beale  Open  Area:  MetalMapper  Processing 


•  MetalMapper  data  collected  by  Parsons  and  CH2M  HILL 

•  Two  classification  methods  to  each  dataset: 

1.  Library  based 

2.  Two-stage  Support  Vector  Machine 

•  A  different  analyst  for  each  method  and  instrument 


MetalMapper  Processing  1:  Library  Matching 


Anomaly  rank  based  on: 

•  Library  polarizability  fit  (3) 

•  Axial  symmetry 

•  Misfit  to  non-UXO  (e.g.,  horseshoe) 

Example:  Pole  Mountain  MetalMapper 
(ESTCP  201159) 
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MetalMapper  Processing  1 
Library  Matching 

•  Aggressive  method 

•  Two  ISO  Missed 
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MetalMapper  Processing  1:  Library  Matching 

•  Two  ISO  stats  Seed  missed 
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•  All  3  polarizabilities  sometimes  not  well  constrained  - 
should  also  use  primary  polarizability  only  fit  for  ISOs 


MetalMapper  Processing  2 

•  More  conservative  approach 

•  Two-stage  Support  Vector  Machine 
classifier 
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Camp  Beale  and  Pole  Mountain  MetalMapper 
Performance  Comparison 

•  Performance  and  data  metrics  calculated  at  both  sites 

(SERDP 1637  poster) 

•  Sensor  positioning  slightly  better  at  Pole  Mtn.  than  Beale 

(A/-po|e  =  0.08  m  vs.  A/'bea,e  =  0.20  m  for  UXO) 

•  Additional  noise  due  to  magnetic  soil 


Beale  -  Parsons  Beale  -  CH2M  HILL  Pole  Mountain 


Beale  Treed  Area:  Man  Portable  Instruments 


•  TEMTADS  2x2  and  BUD  data  sets  processed  using  the 
same  method  as  was  used  for  the  MetalMapper 

•  MPV  results  provided  to  us  by  Nicolas  Lhomme  (ESTCP  201158) 

•  A  different  analyst  for  each  method  and  instrument 
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Beale  Treed  Area:  Man  Portable  Instruments 
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Diglist  Progress:  Training  Data  Requests/Can’t  Analyze 
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Diglist  Progress:  Final  Dig  Summary 
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Discrimination  Summary 
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Beale  Treed  Area:  Man 

•  Similar  performance  for  each 
instrument 

•  100%  of  UXO  found 
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Portable  Instruments 
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Conclusions 


•  Effective  discrimination  could  be  achieved  at  the 
Camp  Beale  demonstration  site  using  both 
MetalMapper  data  and  data  from  Man  Portable 
systems 

•  Man  Portable  systems  performed  very  well.  Each 
of  the  three  Man  Portable  Systems  had  similar 
discrimination  performance 
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Future  Work 


•  Retrospective  analysis  to  identify  potential  areas 
of  improvement 

•  Develop  more  efficient  QC  and  model  selection 
methods 

•  Continued  evaluation  of  novel  discrimination 
techniques  being  developed  in  on-going  research 
projects 

•  Continued  tech  transfer  and  training 
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